Modeling Human Sentence Processing with Left-Corner Recurrent Neural Network Grammars
نویسندگان
چکیده
In computational linguistics, it has been shown that hierarchical structures make language models (LMs) more human-like. However, the previous literature agnostic about a parsing strategy of models. this paper, we investigated whether LMs human-like, and if so, which is most cognitively plausible. order to address question, evaluated three against human reading times in Japanese with head-final left-branching structures: Long Short-Term Memory (LSTM) as sequential model Recurrent Neural Network Grammars (RNNGs) top-down left-corner strategies Our modeling demonstrated RNNGs outperformed LSTM, suggesting architectures are plausible than or architectures. addition, relationships between cognitive plausibility (i) perplexity, (ii) parsing, (iii) beam size will also be discussed.
منابع مشابه
Recurrent Neural Network Grammars
We introduce recurrent neural network grammars, probabilistic models of sentences with explicit phrase structure. We explain efficient inference procedures that allow application to both parsing and language modeling. Experiments show that they provide better parsing in English than any single previously published supervised generative model and better language modeling than state-of-the-art se...
متن کاملSentence Modeling with Gated Recursive Neural Network
Recently, neural network based sentence modeling methods have achieved great progress. Among these methods, the recursive neural networks (RecNNs) can effectively model the combination of the words in sentence. However, RecNNs need a given external topological structure, like syntactic tree. In this paper, we propose a gated recursive neural network (GRNN) to model sentences, which employs a fu...
متن کاملAbstract Left-corner Parsing for Unification Grammars
Left corner Parsing for Uni cation Grammars Noriko Tomuro and Steven L Lytinen DePaul University School of Computer Science Telecommunications and Information Systems S Wabash Ave Chicago IL flytinen tomurog cs depaul edu
متن کاملLeft-corner Parsing Algorithm for Uniication Grammars
iii Acknowledgements Like many Ph.D. graduates will say, writing a thesis and doing the research that comes with it is a solitary business. Fortunately I had many people who gave me kind support and warm encouragement throughout this process. I owe a debt of sincere gratitude to each of those people. First, my advisor Dr. Steve Lytinen, who directed my study which led to this thesis. From day o...
متن کاملLarge-scale neural network for sentence processing.
Our model of sentence comprehension includes at least grammatical processes important for structure-building, and executive resources such as working memory that support these grammatical processes. We hypothesized that a core network of brain regions supports grammatical processes, and that additional brain regions are activated depending on the working memory demands associated with processin...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Shizen gengo shori
سال: 2022
ISSN: ['1340-7619', '2185-8314']
DOI: https://doi.org/10.5715/jnlp.29.253